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This paper reports on two -related instructional 
on projects: one completed' and the other .ongoin g, fhe first 
' «r atored-Videotaped-lnstractipn" <(1?VI> strategy in a 
se calculus sequence; the 'Second, an HSF-funded project 
ocomputers^ televisionr tutoring, testing, and related * 
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This paper is^^^^E€^ented as a report of two related instructional- Intervention 
projects.*'''lJne completed' and the other, ongoing. The first involved a "Tutored- 




ideotaped- Instruct! on" (TVI) strategy in a three course calculus' sequence; the 
second, an NSF-funded project usln^mlcrocomputers ; television, tutoring, testing, 
and rejated technologies an4# methods in a "Center for Assessment* Tutoring and i 
Enrichment B?esources" "(CATER). < ' , ' ' ' 

Evaluation results from^the TVI courses are presented as instruraental and 
consequential evidence of the impact of. project. Procedures 1n*both projects 
are outlined, A report of progress in the NSF project ^concludes the paper. 

It should be clearly stated at the outset, that there was never any attempt • 
to conduct rigorous, experimental research. The participants in the projects 
were (are) well aware of the myriad other factors which influenced (or will in- 
fluence) the students involved. Of primary importance is the fact that, in no 
case, dicl the intervention attempt to replace one kind, of instruction with another, 
"Tfte-^object was to provide students with additional services and learning opportu- 
nitles. In Its. simplest form, tTie TVI project did nothing more than motivate 
students tp-spend more "time-on-task" and- this, in itself, was oeneficial. It Is 
hoped that in the NSF project, more influence can be exerted and wore change 
attributed directly to the Instructional strategies and materials. Data from this 
project will not be available for some time, however. ' 

The report is presented in general ly^lnformal style. Specifics and technical 
details are available on request. Further NSF reports are, of course, forthcoming. 
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A "Pilot Project 'in Calculus 10:150 

■^"^^ The Tutored-Vi deo taped- instructi on Wd pVojeict was a joint effort of 
the department of Hathematlcs and the Office of Learning Resources at Northeastern 

diversity; The project adopted V'^oeedures used at Stanford University and^Mass-a- . 
ohusetts Institute Technology in the instruction of engineering* students. 
(Gibbons, Kihpheloe ^ Down, 1977; Lynch, 1977) At*these schools, regularly- 
scheduled classes were .vicleo- taped and the tapes were played back later by a 
tutor who started and stopped tapes on request, answered student questions, and, J 
dealt with student problems. At Stanfard and M'.I.T,, courses -were for in-service 

- ■ ' ^ . • 

professionals away "frc^m campus. At M.I,T., tapes were used to resolve problems 

■ • ^ ~- - 

arising in large-enrollment (300 student) lectures. 

A primary reason for the use of Tfl at Northeastern was ttiat it provided 
otherwise unavailable assi stance to first-year students beginning tlieir studies 
>n June, The engineering calculus sequence 10:150 - 10:152 eov^ers a|fcill academic 
year and students who begin in the summer quarter do not have access to a depart- 
mentally sponsored "Math Workshop" which is available in the Fall, Winter, and • 
Spring quarters- " ^ * » . 

A lecond reason for undertaking tfie project was ths^t, in taping the c^l-^ 
cuius classes, a bank of materials would be created which could supplement in- 
struction in. other situatiojis: 1) TA and tutor trainees could view tapes of a 
senior instructor and extract coi^it'enlf- and instructional approaches; 2). calculus 
students could access the" tapes out of class to-" review specific concepts [each 
tape was accompanied by a time/topic log]; and 3) a set of tapes covering -basic 
concepts and princi^^les -could be edited for classroom -use. 

It was decided that a senior instructor of outstanding reputation should 
teach the' calculus sequence. Prof. Holland Filgo, whose, 'experience', included 
televised instruction, was invited to be the instructor. An experienced tutor- 
was also necessary., Mr. Ahmad Khashan, a graduate student in mathematics was 
assigned the tutor's position. * " • ^ 
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Project procedures were straightforv/ard. Each cUss was videotaped in the 
classroom* the tutor *atten<li ng and making notes of the ^topics* discussed a^id the times 
of the discussion. Videotapes and topic logs were Inmediately available for the tu-' 
tor's use in nearby" rooms. After this initial post-class session, videotapes and 
logs were copied and put on file within 24 hours. One set of tapes and logs was 
kept in the tutoring room, the sectjnd in -a ' Learning Resources Center for access 
by individual students. * • * 

' . .During the summer term and at its conclusion, various data collection methods 
and instruments were used Included in the evaluation were interviews, a locally de- 
veloped survey, the Adjective Rating Scale (Kelly et.al . ' 1976) , and narrative reports 
The appendices here, hold some results from the 10:150 evaluation. 'The local survey 
resuUs indicate'satisfactiop with the quality of the course and the TV I assistance. 
Regular,, informal interviews with students provided similar results* Question asking 
habiVs changed slightly, the extra assistance causing students to question less in 
class, ■ Student reports here coincide with the instructor's narrative report of 
fewer questions -in clas?. The Adjective Rating Scale followed patterns seen in 
previous administrations "at Northeastern University (Theall, 1978) with an even 
heavier than usual orientatioji toward the perceived practicality of th^ courses 

\» * *• 

scale mean was K93 on a 4-point scale with alpha reliability of .944 while 

the usual mean for this scale has been above 2.0. The instructor and tutor were 

■>■ V 

satisfied with the results of the pilot project and wanted to continue with the 
next 'course in the sequence. Grades of students in the course were favorably 
distributed with respect to previous courses and a test-retest option seemed 
(in conjunction with Math Lab activities) to have helped students. Of particular 
interest in the appendix which holds test-retest info»"matiofr\js the ^'performance 
of selected individuals" sheet. As shown, in only two cases v/ere retest per- 
formances worse than the original but these were the only cases where the .Hath 
Lab was not used in preparation for the retest. The tutor's narrative notes 



the regular correlation of Math^ lab atte.nd^ince with enhanced performance. Even 
if learning was a function of more, guided "tiroe-on-task", the -proce^ res in- 
volved seem to have had a positive effect.^^' A report of evaluatton data' was 
presented in September 1978 and the decision was wade to contijf^e the TV I 
project in' the Fall' semester. * " 
Calciilus 10:151 . { ; . ' j 

In- the Fall 78 ^t^erm, TVI activities were expanded. The second .course in 
the engineering calculus sequence (10:151) wa's video-taped and the summer video- 
tapes were used with two new sections of 10:150. Professor Filgo taught one 
section each of 10:150 and 10:151, Mr. Khashan provided tutoring for 10:150 at 
Boston and Burlington campuses, and another tutor assisted in Prof. Filgo's 
10:151 section. Procedures were generally similar to those used in the summer 

session. • ^ 

'A unique feature j)f Prof. Filgo's classes was the continu'ation of the test- 
retest option used 1n conjunction with tutoring. The object of the. option was 
early diagnosis and correction of difficulties. Each test had two equivalent 
forms. The instructor carefully corrected test 1 and noted-weak areas. Any 

t 

/ 

student could retest but attendance at the "Math Lab" was strongly ^ommended. 
Students who^ failed the first test could not retest unless they had attended 
the "Math Lab". The retest option was quite successful. Of the W retes^ in 

10:150 — 10:15Z. Bf% resulted in higher grades. Of the remaining retests, 1% 

1 ' ■■ 

showed equivalent performance and 9% resulted in lov/er grades. Througti the series 
of tests,- retest performance was best. for those students who regularly used the. 

)"Math Lab", ' . 

/ In the Fall 1978 term, evaluation activities were, also broadened. 'In 
addition to student attitude, opinion, and performance data for participating 
classes, an attempt was made to dej;ermine factors important to student performance 
and all data was also collected from three NON-TV I math classes. The purpose of 
the NON-TVIdata collection was more informational than comparative. No hypotheses 



" were generated about the effects of TVI or? Its relationships to student attitude 
or. perfonnance. Neither were assumptions made about the: superiority of one for- 
mat over the otherV As a result of the initial evaluation, the following ques- 
tions were considered: , 

Are student attitudes similar in concept and^ strength to those 
found in the inittal ev-aluation? . - • ^ 

2. Do students in TVI courses attribute their performance to the 
• ^ same factors as do students in NON-TVI courses?, 

3, Are there differences in student opinions about instruction in 
. — TVI and NON-TVI courses? ' , ^ • ' 

4- What are student attitudes about. TVI and their tutors? 

5. What is the student estimate, of the value of the TVI format? 

6, Are there any relationships between TVI and overall student ^ 

» performance (as shown by course grades)? " 

/ 

, From the initial evaluation and a review of evaluative literature, the 
following patterns were anticipated: * 

♦ 

1. Senior instructors would receive the most favorably student ratings,- 

2. Students "would consider their own effort and ability as the most 
important factors in their performance. 

3. Many students in tVI courses would credit tutoring with having 
raised their grade. > . . > 

4. Tutors would receive good student ratings and videotape alcine would 
be considered only marginally helpful. 

5. The distribution of grades in TVI courses, would be skewed toward 
the 'A' end fh comparison with' past NON-TVI courses, 

6. Students would be oriented toward the 'practical aspects of their 
experience and consider it to be very. worthwhile but would not 

■ rate" its intellectual appeal as highly. 

♦ * " 

7. A high percentage of retest scores would show Improvement. 

ERIC 



^ ' 5 

The anticipatec! patterns were confiriued. Senior instructors were more 

highly ranted than TAs or junior Instructors (tutors are rtot l-ncluded in this 

Statement). The "combined" data presented later in this report thus give an 

overall picture, and comparisons of TVI and NON-TVI should not be made using 

this data. Individual instructor's ratings varied considerably and this var- 

lance clouds such comparisons. On the whole, rati-ngs of instruction indicate 

a high degree^of student satisfaction In the engir^^<iring calculus 10:150 and 

10:151 courses.. In fact, it is suspected that some of the effect of the TVI 

format was lost due to the generally high quality of instruction. In other 

words', the better the instruction, the less the need for assistance and the ^ 

closer the\^atings of students in Tp and NON-TVI groups. 

Both tutors were highly rated in their tutoring roles. Though indi- 

vidual data are h9t preserved, it'., should be noted that the Burlington students 

gave Mr. Khashan exceptionally high r^ings and it was^ through their efforts 

and insistence that Mr. Khashan continued in the tutc^rtng role during the sub- 

•, sequent quarter. In all tutored classes, students who used the services cred- 

.ited tutoring with having positively -affected their grades (see Item # 39 in 

the "combined data of TVI classes" appendix). Videotapes alone were not con- 

« * 

sidered very useful. 

The attitudes of students and their attributions followed the expected 
•pattern. Students placed a high value on, and were well satisfied with the 
practical aspects (the "worth") of their courses- They did not rate the in- 
tellectual appeal ( the. "interest") of the courses as highly, but there was ho 
reason to expect such a rating. The courses^were considered to be of average 
difficulty. Both TVI and NON-TVI students considered their effort and ability 
^to be the^most important factors influencing their performance and both groups 
were in general agreement about the relative importance of the other, related 
factors . 
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The grade distributions in Prof- Filgo's classes were skewed toward the 
'A* end of the gr^iding scale. Average student performance (as judged by courie 
^ grade comparisons) was higher in these classes than In all but one other 10:150 - 
10:151 class since the Winter 1976 quarter. Common final exams are used in' the 
l£l: 1150-51 -52- sequence, thus, some control can be said to exist over the pd"ssibil- 
Ity of classes being graded on different criteria. The retest option allowed 
many students the opportunity for improving grades. Of the It*? retests taken, 
-IH resulted in higher grades, 12, in similar grades, in lower grades. Atten- 
dance at "Ma th^ Labs" was again related to Improved scores. 

^^^^^^^j^ final note should be inserted about Hath Lab attendance. Although the, 
instructor and development personnel were somewhat disappointed by the. frequency 
of students ''use of the service, an interesting comparison can be made. During 
^ the* 10 week 10:150 sequence, some 120 .contact hours of ,tutoring were recorded: 
this service was provided only for the 24 students in the 10:150 group. During 
a previous quarter, when a departmental ly offered, drop-in-type, "math workshop" 
service was ava\lable to all students taking math, ihe number of contact hours 
was only 90, The retest option and the relevance t^ 10:150 performance are 
considered to be the major reasons for greater attendance in the Math Lab. 
Conclusions about 10:151 

There seems enough information available to answer the qfiestions posed 
earlier.' Student attitudes toward instruction appear to be consistent and. pos- 
itive in both -TV! and NON-TVI courses. Likewise, attitudes about the 'tutors 
and tutoring are positive with the emphasis on the tufor rather than the tech- 
- nology. The overall effect of the TVI format on grades seems positive but that 
effect is seen as a function of diagnosis and correction through both tutorijig 
and the retesting option. It is felt that neither tutoring^ nor retestiji^jv^ld, 
alone, account for such grade improvement. 
Calculus 10cl52 

The third course in the calcalus sequence, 10:152 was videotaped in the 



same manner as its predecessors. Aqain» Professor FIIqo was Instructor and Mr. 
Khashan was tutor, . Class procedures-^ retesting, and '"Math Lab" activities were* 
.similar to those in previous courses. £nd-of-course eva-luatloh was similar in 
th^t a survey, the Adjective Rating Scale, and attribution questi cos were used, 
but in this ca^e no compaitative groups were surveyed . This decision was made 
because t^e primary concern was witl) continued student satisfaction and "progress 
rather than proving ^j^^ superiority of one method over another. Evidence from 
the 10:151 evaluation had already suggested generally high qual-lty of Instruction 
by persons in the calculus sequence and the TV! project was only a part of Vthe . 
overall Instructional treatment. It was expected, in 10*: 152, that pattens, of 
responses would be similar to thp^e from other evaluations. -These expectations 
were borne out. Appendices to this report include the 10:152 survey. Adjective 
Rating Scale, and attribution items as wel.l as grads&^^or cros,s -course compari- 
sons. As before, students reported satisfactijwfyfth the course and with TVI; ' 
were oriented tp> and thought highly of fh^ practical value of- the course; and 

attributed their performance largely to their own effort and ability'. -The Ad- 

» 

jective Rating Scale results show, for the first time, a distinction between 
the positive and negative aspects of "worth" r ^ distinction found in the original 
factor structure of the instrument. Grades were distributed along expected lines j 
with a high percentage of 'B's (42%) and no 'D' or 'F* grades. An interesting 
change in attributions is seen with respect to t^he rankings of the instructor's^ 
personality and teaching ability. Perhaps as a function of increased self con- 
fidence or the fact that assistance was available, the TV! students ranked in- 
structors contributions ashless important than did NON-TV I s-tudents. Beyond 
this, the 10:152 students considered personal fluctuations of mood, condition, 
etc. and course design as more important than the instructor's teaching ability. 
Given the high ratings "received by*the instructor and thus the removal of the 
poss/ibility that students had no choice but to be self reliant, an interesting 

possibility is that confidence in self may be enhanced by special assistance 

? i 




pifog rams' which, through provision of'successlk experferjces; allow earlier de- 
velopment/maturation. ?^ • ^ ' 

Suntnary " v« ' . , ^ - 

"•In general, it is felt that the TVI program had a positive inrpact! The 
cost7effectiveness of the pfograrn was not addressed in the original evaluation 
because some propos-ed uses -of the videotapes had not been implefnented. Present 
da*ta indicate that TVI may help in retaining students-who would not otherwise 
be able to pontinue "in their acadenic programs. The retention of only a few 
such students' would return 'the costs of the service. With the acceptance of 1^ 
the NSF proposal which, is discussed in the next section, the question Qf TVI 
cost:reffect1veness became essentially unimportant.. The experience gained 
in TVI .and the existence of the three-course set of videotapes make TVI well • •. 
^ worth the expense. In fact, the ojily direct costs for TVI included additional 
videotape, p«*rchase and partial release "time for one* instructor. Tutoring pos- 
"itions would .hav-^ been assigned regardless^ and Office of teaming Resources 
Staff and servs^ces were essentially within existing budgets. 

expanding" the tvt concept " A • 

Though TVl was- effective, reports of success with more complex technol- 
ogies (8orj<, .1975; Bowles, 1977; Br*«dt,'" 1979; Daly, Dunn, & Hunter,. 1977; 
Dowd, 1977) . prompted the development of a proposal to the National Science 
Foundation for the cneation of a program e)^anding ^the TV..I experience into a 
multiple technology instructional system us in^ tutoring, computers and tele- 
vison as primary vehicles for special instruction in calculus and pre-calculus 
courses. 

There were four problems of primary concern in these courses: 

1. Faculty who^ teach in large-enrpl Iment, service courses cannot provide 
individual attention to. those students who need assistance. This in- ' 
eludes students v/ith minimal preparation as well .as advanced students. 

2. In sequences such as pre-calculus and calculus, no time exists to dem- 
onstrate the application of mathematics to the specialty areas of the 



students or ti) ^proyl^e exercise/practice in these areas Opportun- 
ities for interdisciplinary exctjange^re thus reduced, ^nd conceptual 
difficulties ofteji arise wheo students attempt to make the 'transition 
from" the abstract matheniat4cal principle to the concrete engineering/- 
"science problem. • ^ , • ' " . l, > . : 

The problems of underpreparatlon and reduced available faculty .tiW 
'cause more and more instructional responsibility to- fall -on tutors 



■ " and/or teach1n"5 assistants. These persons are chosen because of ' . * 

' ■ ^- ' • ' •^ .J ' " 

V . , deroonsifc^j^ted ability in the subje^:t area ^ a paramount considera- 

• - tlon ~ but their content expertise does not guarantee their peda- 

. gogical "efficacy.^ Their repertoire of instructional strategies ^ 

'is often limited and they do not -have easy a,ccess 'to instruct! Oinal 

aids and/or assistance. As, such, they are most limited in the area; - 

^ where the greatest problems existrthe instruction o€ beginning " , 

students who are having difficulty in mathematics. 

4- The needs of advanced students are often overlooked. These students 

must have access to faculty if they are to be provided with enrich- 

ment materials- and/or ch.a'llenging projects. In the situation where ^ 

faculty time is a*t a premium it is often impossible to work with 

advanced undergraduate students. 

^ ■ ' , t 

In order to address these problems, a Center for Assessment, Tutoring, and 

Enrichment Resources C-C^A.T.E.R. ) was proposed and the following objectives were 

established: 

1, To design or, adapt • 35 "drill-and-practice" units covering the 

^ . major topics in each of the five courses, and to make these units 

available to students for individualized instruction by means of the 



computer. 



2,., Toifyroduce on* videotape five iS) lectures by engineering faculty 
concerning applications of calculus to their disciplines, and 
to interface' th.ese with special practice problems fnade availafble 

^ on the computer. 

3. -To integrate the existing videotapes of^^he entire freshman engi- 
_ neering calculus sequence^into *the proposed individualized instruc- 

• tion' "drill -ahd-practice" exercises on the computer*. ' » 

• ' " / ^ ) 

4. Jo use the computer for the dia<gflostic and 'placement tests admin- 

• . 'istered to all freshmen in the summer and fall. * 

5. To use '^video tapes of classroom instruction by experienced faculty 

- to fmprove'the Instructional skills of graduate teaching assistants 
jand tutors. , ' ' . * « / • . 

> The timetable for implementing the project is displayed on the follow- 
ing pages- / ' • . ^ ' ' " 



tBlETABLE OP project" ACTIVJ^IES , 

Purchase and tnstallation of Software 

•♦'Lessonwrlter'* computer package from Or. 4oh« Oe ford , UnlversI tv 

of Utah . 
"Coarse Hanaa«fl»«r»t** computer packaae from Or. Kenneth Oowles ^ 
, Uoiyersltyof Call/ornla, San Olego % ; . * 

"Graphical Characteristics of .Funct4ons,** "j^ppJIcatlon of, 

Ca 1 cu i us to th«, Oes Ign of* th«t 0 1 esfrj ^ Cng I »*' videotapes . \ 
froin Or,. Antimony t; iN^e5slnr, UnWersMy;: of l lUools . > 
♦♦CfursewrUer** computer package from Or, A^fr4d, H, 8ork» ' ' 

University of CaHforft la, I nvloe „ i V /* Huj^ ' ' . 

"Engineering Caiculii-$ forjMlnorrtV .Students ,f computer' testing - 
. package from Or, Gregory HamI I tdri^ Hrchlgan State, University 

Purchase of Egulpment • . \ • 

Terak. Corporation Hode I 85IOA o»lcroGomputer (h) 

V|deocassette:f> layer (l) • > 

/ '9'* TeieOlslon, <2) , / < ' , 

Videotape ContreUer (2) . « V • • 

Study Carrels ' . / i 

Construction^ of Physical FacI 1 1 ty (convert , exist I ng class r<)om) 




Employ Comi^ter Prografwner 



Oevelopment of Or! ll-and-Practlce Units: ' 

Pre-Calculus Course IQAhk, ♦•Addition and.^|lractlon of Polynomials 
^ ^ »0 1^S, "Solution of %M^^rat1C Equations'* 
Calculus Course 10.150, "Functions , and Graphs" 

10.151, •♦Area Under a Curve" ' I 
|O.I52» "Integration Technlijuea: Suba Citation** 

Videotape/Computer Application Units 

"Applications of Probleros Solved UsIng/Hax-MIn Theory In the 
Calculus of One Variable** 
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Vail 1975 
(continued)' 



; - tIMEXABLR OF PROJECT ACmif IBS 

EVEMT • 
Classroom Vldeoloi^f^st Revii^w> Edit and Cross-Reference Existing tectufes 
CofVstriictlo'n of Physical Facility (convert existing ^classroom space) 



Tratnlng of Professors Brld^er ^and ClafUn In Use of "Coursewrlter** 
ai><l "tess<>nwrl ter** Software . * 



Wlnte.r }980 



Oevelopmenfof Orl U-anrf' Practice Onlts: ' ■ 
Pre-Calculus Course I0HH» "Multlpl Icatton an<W DNUIon of PolynonKlal^^* 

- iOjH'i; "Spec U J Products and Factoring I** ] 
, * IO.M15, **Graphs of Linear' and (Quadratic Equations' 

CaUuhis Course )0. 1507~^''£lementary tlrol ts of Algebraic, functions** 

10, ISO, "Slopes of ilnes and Linear Equations*' 
10,151. *'Volufl>es by Slicing**- 
' ' ' I0.IS2, 'integration TechnlquesJ 6y Parts** 

Vldeotap^/Cofljputcr AppI Icatlons Onl ts j - . 

♦'Scientific Applications of Related Rates Problems** 

Classroom Videotapes; Review^ Edit and Cross Reference Existing -Lectures 

Construction of Phy.slcal Facility 

Supervlslofi of Programming Activity * ^ ' 

Evaluation ' 



Development of Orl M-and-Practlce .Alnl f i 

Pre-Caiculus Course lO.l'iJ'j, "Specla-I ^'roducts and Factoring It** v 

10,1^15, *'Slroplft Word Problems" 

. lO.l^tS, ^'Linear Systems In Two and Three Unknowns*' . 

Calculus Course I0.150* ^'Derivatives of Polynomials** 

10.151. "Vford P rob lews** 

lO-ISi, "Volumes Using Cylindrical' Sheiaa" 

10- 152, '*lntegr5(.tlon Technique* : Trigonometric Substitutions 
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TIHETAULE OP PRO JECt •ACTIVITIES 



.1 



I r 



/ 



/ 



. TIME 

" SftrlnR 1980 
(cont in«e<l) 



• video tape^Coinputer Apr^'ll<^]atl<in U«lt« 'J ' / / 

* "Application ol ^^pa/abjt<i Mfferedtlal Equations to '.eal World PrAWfemat. 

.Oealgn diagnostic* teatlog program for all* f reahmen 

, ■ I-- f ' • , ■ • _ 

Ciaearoom Video tapaa.; Ee^lei^^, Edit and Cross-Reference fixlaifntt Leo^turea' 
Evaluation .• / •- ' \ 

Sununer 1980 ' Oavclopmenf of Otlll-and-Practice Unite j ' - . /' i /. 

Pre-Calculus Course I0.1A/»» "Addition and Subtractl^^ of^Cgelir^c FtactloiiB** 

Calcjjlus Course 10.150, "Oae of the Prp|'uct*'ftnd. Quotient Rides** 
. / l6.l51» *'Logarithailc F^ctlcfns!* vf • " / f 

10.152, "Integration JPecljttlquea^/partlal/ Fiaetlons" 
" < 10,152, "Inteeratio|/t&chni<jue|r| Power^ anfl Products of 

Ttlgono^tr.lc Functions**. / / 

A y/ ' . '' ^ ' . / j 

Intplewenc; Pleld-Teat, Eevlae MathcinACl^i Bla^ttbatlc Pic^grain for all Freshmeti' 

• / # " / I 



/ 



/ 



Eotabllah ^nan^geinenC procedute^ 



/ #. t/ 

fCjI.^T.E.R. faclUty 



ftatheinatlcs faculty workshops ^n ufl^' of C.A.T.E.R'* facility 



train tutors and CA.T.E.R. ystaf 



.J' 



Pytrchaae of Equipment 'jj y 

Terak Corpora t toil lj^deljO5*l0A w»icroc^^ (A) 
Videocassette Player i'^jf 
^ 9" Television {2^ '/ f . s 
Videotape Controdler/(2) 



Terak Proctor jorailnal 



Evaluation 
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TIKE 

PaW 1980 H 
T25t of ail* 

ejcrlog students 
MSG C.A.T.E-R. 
faculty, 225 
students) 



TIMETABLE OF PROJECT ACTIVITIES 



Development of *Drn I -and^PractjlciB iJnItst 

ffe-Ca I cuius Course 10.U*», "Mliltli^llcatlon and 0iv4alon of Algebrtalc Fractions** 

iO. Mi5. "Definition of Trigonometric Functions': Special Angl 
Calpulus Course 10. 150, *»Graphs of Trigdnomeiric functions** ' 
010, 15J\ VExponential Ftinctions« 
^ 10. 152, "Polar Coordinates" 



Vf'deotapc/Computer Applications Units . . 

"Appiicatiort of Integration to Problems' Involving Worlc, Pressure and 
Center spf Hass" 



Implemcf^, FieW-test and Aevlse Programs ^ 
Management of CA.T-E.R, Facility and Oevejopment of Instructional Haterlals 



Eva luat^on- 



/-'. 



winter I98| 
TSOVofTlT 
freshmen 
engineering 
students use 
C.A.T,e.R- 



Oevelopfljent of JDrl ll-and-Practlce, Unl ts . 
Pre-Calculus Course 10. Hi^i, ''Rules of Exponents*' 

iO,l'i5, ♦♦Inverse Function^** 
Calculus Course 10.150, **The Chain ftule**^ 

1 0 V i 5 i , "Tr I gonome t r I c f unct I ons** 
152, '♦Taylor Ser I es*» 



f ac 11 1 ty , 

*»50 students) VIdeo/Compater Appllcatlos Units 

'•Planetary Motion" 

Management of C.A.T.E-H- Facility and Development of Instructional Materials 
Evaluation 



IS 



TIME 



TIMETABLE .OF PROJECT ACTIVlTIjES 
EVEHT • 



Sprtnj; 1981 1>«vftlopt»eiic of DrlJLl-ffnd~Practlc« Unite 

(75% of" oil Pre-Calc«l«8 Course 10.1^4, "Solution o'f Linear E<iuotiona** 
freshmen engi-r > 10«145» "Inequalities and Absolute- Values*' 

n^ering mathe- Calculua Course 10.150, *'Curve Sketching Oaing Derlvatlvea" ^ 
t^tlco otudenta , 10.151» "Inverse Trlgonoinetrlc.' Functions^* 

use C«A,T,E.R, . 10.152, *'Indeterminace Forms" 

facility, 675 . . " . - / 

students) Video /Computer Applications yaitst • . . ' ' 

^ • "Edttins and Revision" , * « 

- * ' ' * 

' Mi\nageroent of G-^A.T,E.R.- Facility and Development of Instructional Haterlals 

Evaluation * , ' ^ * ^ ^ 



Summit 1961 Revlae Drlll-aad-Practice and Vldeo/Computet Applicatl^na Units Baaed on 
(100% of xiU Evaluation Data ; , 

freahman engi-- ^ ^ 

neferlng laache- Workshop for faculty from other departiaents and colleges on C.A.t.B.R. fuclllty 
dents use 

facility^ 
900^ 

students) 



Purchase of E<luiplnent^, * * 

Terak Corporation Model 8510A i^lerocoinputer (2) 




•Evaluation 



Fall 1981 



Revise 0rlll--and-Praci:lce and Video/Computer Applications Units Based on 
. Evaluntlon Data 



(lOOZ of all 
freshman cngi-- 

^ -Sneering mathc- Workshop for faculty from other departments and colleges on C.A^T^E.R. facility 

^^nts use 
C^^A.T.E.R 
^.^^clllty, ; 
900 students) 



Evaluation 



T1HE 

Winter 1982- 
i\QQ% of aTj . 
freshman en- 
gineering 
ma thematic* 
students us,e 

f^cHl tV, 300 
students) 



• ' TIMETABLE OP PROJECT AeTIVIITIES 
' £V£HT . .. 

4<evlse Oriy-and'Practlc« and VNeo/Computer AppUcatlons Units Based on 
Evaluation Data ' 

• ■ ■ f • . 

* • '> » ^ < J 

Workshops for faculty from other departments and col leges. 6rv>C.A.T»£,a^ facHlty 

EvaJUatlon * 



V 




Sprlna J 982 Revise arl H-and-Practlce and Video/Computer AppUcations iintts Based on 

TlOO^ of ail Evaluation Oata ^ ' 

freshman en^ * . 

glneerlr^g Workshops for faculty from other departments and colleges oo C.A.T.E.fl. facility 

watheiAatlcs * , ^ 

students use * . ^ ^ 

C.A.T.E.R. , Eyaluatlon * . ' ' 

JacHlty, 900 ^ f ' ' * ^ . 

students) ' Synwnatlve evaluation report x 

Plan for program continuation t 
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Organizationally, the project had three inajor components: 1) instructional 
development and evaluation along with facilities design and administration were 
under*vthe Office of Learning Resources; 2} roath curriculum content and programming 

9 

were under mathematics department; and 3) engineering faculty were responsible for 
Content in tl\e "applications" units, - The organization is outlined in Figure K 
Staff time- was distributed as follows: ' ' 

' ' ' ' - TABLE K DISTRIBUTION OF ST-AFF TIME * " 





Summer 
^ 1979 


N 

1 

9/79-6/80 


Summer ^ 
1980 


* 9/80-6/81 


Summer 
1981 


1/81-6/8 


-Project Director • 


16% 


. 11% 


16% 


11% 


16% ■ 


11% 




16%- 




0% 


33% 


6% 


33% 


/I 


0% 


. '22% 


22% 


^ 22% 


0%' 


0% 


. Math Faculty <r 


0% ■ 


- 33% 


0% 


33^ 


0% 


0% 




0% 


11% 


33% 


0% 


•0% 


0% 


Programmer " 100%. 


100% 


100% 


100% 


0% 


0% 


OLR Director , 


10% 


' 10% 


10% . 


10%. 


5% 


5% 


Evaluator 


0% 


11% 


22% 


22% • 




^. 33% 


, Instruct. Designer 


0% 


' 11% 


' 0% 


1.1% 


5% 


5% 


' Engineering Faculty 


■ 0% 


11% 


0% 


11% 


0% 


0% 



Expected Benefits 

The five pre-cal cuius "and calculus mathematics courses affected by this pro- 
gram are central to the development of over nine hundred (900) engineering students 
each year. At the present ttme a large, number of these students are handicapped by 
poor mathematics preparation. Because of the number'^of students and other demands 
on their time, faculty cannot-give these students sufficient individual attention. 
The majority of such students suffer not on^ in their mathematics classes, but in 
other -related fields, particularly physics and chemistry, in which the application 
of calculus is expected. The software development and computer-assisted instruction 
facility would make "it. possible for individual students to test tneir understanding 
of subject matter, unit by unit, and to obtain supplemental instruction, either in}" 

the form of special videocassettes or tutors. 
ERIC 2 1 



FIGURE 1 

N,S;F. "CAUSE** - ♦♦C.A.T..E-R-" OROANllATIOH 
; ' PROJECT MRE^TOR. 
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The existence of such computer assisted learning centers on campus Is a 
predictable development in higher education. According to Bowles (ISTT^-the qost 
to own and operate a micro'computer suitable for computer ba|ed instruction amounts 
to roughly $0.^50 to $1.00 per hour pf use (depending on volume). The falling equip 
ment, prices mean that the hourly cost will fajl to roughly $0,10 per hour by the 
early 1980's. ^owles cdncludes that with such. companies .as Tfexas Instruments 
entering thfe microcomputer market, 'the cost of equipment in ten 5'ears'will be so . 
16w t-hat the essential issues regarding the use of computers for instruction will 
be purely organizational. Given the number of students in this project, the only 
cost-effective alternatives involve the use of technology. Furthermore, s.ince a 
primary goal is to strengthen the students' grasp of important matheirtetical pro- 
cedures, an interactive technology must be used. The computer ideally suits these 
requirements. > ' • ' 

The MSF/CAUSE project will serve as a vanguard for the instructional use 
of the computer on the Northeastern University campus. If successful , >he. project' 
dril 1-and-practice, record-keeping, -and videotape applications procedures would 
ispread to other large service courses, particularly in the physical and biological 
sciences. While the proposed facility was designed primarily to service the nine 
hundred (900) students in five freshman engineering mathematics courses, it could 
eventually servi-ce other courses and departments, and could be expanded to include 
more terminals. Of particular interest in this project is the application of com - 
puters to assist not supplant, classroom i nstruction.. H<S technologies in the past 
have proven themselves the equivalent -of effective classroom instruction. The com- 
puter here is interfaced with another powerful technology, television. The Qombina 
tion of these two technologies overcomes deficits of each one individually. The 
computer lacks the visual and auditory stimuli of television, not to mention the 
advantages of motion. Television hov/ever, lacks the interactive branching and 
record-keeping capabilities of the computer. Eventually the videocassette will ^ 
be replaced by the videodisc, which will greatly increase the pov/er of this com- 



*puter/video interface. Also Included in this project Is the tutor, both in tne 
role of small -group Instructor for tutored videotape instruction and in the con- 
ventional role of individualized tutoring.. Detennining the extent to which the 

^tutors can manage and utilias the powerful ^technologies at their disposal may be 
one of the most practical outcomes of the project. 'Additionally, the potential 

-exists to undertake research of a more >^i^Lous natu-re. .Questions related to. 



"math anxiety", motivation, attribution theory, 'cognitive style, and other con- 

♦ 

,structs can be addressed in the process of testing 'andMmplementing the program. 
The development of general izable software (eg.: CAI units on problem solving, 
heuristics^ exploratory rather than didactic lessons, etc.) is also a distinct 
possibility* * ^ * 

Progress to 8ate 

% 

This. -section briefly outlines events and accomplishment? in the NSF* - 
"C.A.T.E^.R." projp^t. Categories of activities are isolated for ■simplicity 's 
sake. 

1. Hardware/ system software are presently operating on a. 1 imited'^basis^ 
> Four TERAK computers are in use and, a,^^ an initiaj period of technical • pro- 
blems, are operating reliably. Perhaps the major' delay to date has- been with 
system- software. Originally, it was planned to use.th^ "Lessoriwri ter" (Brandt, 1979} 
1979) language from the University of Utah. The "Coursev'/ri ter" • language (Bowles, 
J977) -from University of California at San Diego v/as considered as a supplement for 
special needs in (for example) course administration. --Jo th languages are "PASCAL" 
derivatives. Because of the highly interactive nature of the lessons planned 
here, the usefulness of the two derivative languages was unexpectedly limited. 
At present, authors are generating lessons on ^aper and programmers are enter^ing 
these lessons into the system in "PASCAL". Simultaneously, special software is 
being created to provide additional graphics support; extended options for eval- 
uation of student responses; exploratory structures for lessons in the "discovery" 
mode; expanded* character sets; extremely pov/erful text editing; and other similar 



purposes. Much remains to be done In order .to make the system software as 

powerfuKand fle;^1ble as possible. 'The reasons for creating such powerful 

software are found in 'the instructional design strategies >outlined below. 

Z7 Instruct tonal 'design considerations in .this project have put heavy v > " 

demands on lesson writing software. A prototype lesson v/as created 'early in ' 

the project and it followed a generally traditional format. Expl ana tpry mater- 

ial was presented firsts^fol lowed by a problem. Based on the student's reply to 

a multiple choice question^ "right/wrong branches, were executed, Distractor items » 

inJi^e question .v»/ere thosen to represent the, realm of 'results one might get having 

made one of the "typical mistakes students make in these problems". Incorrect 

i ^ ' * ' , . ■ 

choice branches were thus determined In a quasi-diagnostic manner* Given an error" 

"indicating a major problem, students would be channeled through a second explanation/ 

^pr^blem sequence and, eventually (given a second major error}* would, through the 

computer/TV interface, see a brief videotape explanation of- the topic taken from 

the set of TV! tapes. • '* " ■ ' ' ' % . ■ 

As discussrions on instructional strategy continued, and 'as problems with 

existing software arose, a new direction took shape.". Assuming that all material 

would have been covered in class, more emphasis "was placed on the notion of "drill 

and practice". Preliminary explanations were dropped in favor of immediate problem 

solving or more discovery-oriented strategies*. Both strategies; however> placed « 

h.eavy demands on software. Rather than. providing^muHiple choice questions, for 

example, it became ne,cessary to have the computer evaluate mathematical notations/ ^. 

equations entered by the student. Another possibility was for the system to 

allow the student to enter and manipulate parameters for., for example, .curve sketch- 

ing or adding functions. The complexity of such demands has initially "slowed deve>lop 

ment of both software^rid course materials^ but is expected in the long run, to allow 

much more sophisticated lessons to be created. " " ~ 

. 3.' Curriculum content has also seen extensive discussion. The original 35 

units may be reduced in number and an extensive context investigation is underway* 
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in an effort to Identify concepts and operations crucial to understanding the • 
course material. This refinement of content may lead to cle.arer i<ientifi cation 

of key issues in many areas. 

'■ ■< ' ' 

4. The C.A.T.E.R, facility has been designed and prooosals for construc- 

/ 

tion have been submitted. Construction Should begin in Hay of 1980 to .be ready 
for the freshman class entering in September 1980. Construction plans include 
carrel placement, design of study and tutoring areas, location of equipment, 
lighting^d acoustic control, etc. to create an environment with maximum 
utility and minimum distraction-.-- * 
Sumniary 

The multiple technologies project is generally on schedule b'^ expending ■ 
much more effort than anticipated on system software and instructional strategy. 
To date instructional materials have only undergone content~face-va,l idity revvew. 
Field , tests with students will begi^n in March 1980. Despite the complexit4es of 
creating instructional niaterials and strategies which match the sophistication 
of the delivery sys terns » progress has been consistent and the benefits antici- 
pated from, the project remain achievable. 
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EXTRACTS FROM " 
THE INSTRUCTOR'S 
NARRATIVE REPORT- 
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Surely the most important que^stions we would like to have answered are: 



U How well, are the students in this class doing? 

2. How do they compare with classes in the past? 

3. If there Is a difference, what'caused it? . - ' , 

^ J 

First* I shall give my opinion- on at least the first of these questions. Then 
I shall discuss how the experience of teaching this course has seemed different 
to me from the usual course. - *• " 

A. THE ACHIEVEMENT OF THE CLASS 

Hy gut feeling is that this is a very good class. The students seem inter- 
ested and attentive. They seem to have a good understanding of the basic concepts;,, 
and they have unusually good skills at the mechanics of this course, e.g. equation 
of lines, differentiation formulas, trigonometry formulas. I was surprised at how 
little trouble they had with something like the chain rule. Their grades at this 
point (just before the final exam) tend to bear out this impression.. The only 
things that detract frow this picture are: (1) in trying to make tests which could 
be graded (Quickly, I probably tested more than usual their ab1>ity" to do isolated 
tasks and less than usual their ability to ail^lyze and solve a complicated problem, 
and (2-) in trying^to proceed very carefully, I paced the course a bit slower than 
usual- A possible third factor is th^t a good many of these students had a year 
of calculus in high school. I do not know if that is typical of a 10:150 class. 

8. 'the experience of teaching this class 

Here are some observations about how this class seemed different to me. 
In some 'cases, I shall speculate on possible reasons for the differences, in 
others hot. " - 

* 

1. Most' noticeable' was that the students a^^ked very few questions in 
class. White it is not my stule to get a lot of student discussion, 
I normally expect a lot of hands to go up when I ask if there are 
questions about homework. In this class, I practically bad to beg 
them to get such questions. 

2. Very few students came to my conference hours. This was, quite 
noticeable, V si nc-e freshmen tend to come for help much more often 
than advanced students. 

3. I was somewhat less relaxe^j than usual in front of this classj 
Here are the reasons that occur to me: , . 

A. Everything I said has^ljeen recorded for "all the worldj^to hear. 

8. Having been designated as a "good teacher", I felt I had to live 
up to that. 

C- I was being observed by OLR people and by Mr. Khashan, who is 
an excellent, experienced teacher. 

0. At first I did not feel that it was m^ class. I was unsure 
whether 'a committee was in charge of the class, whether Khashan 
and I were^in charge of the class, or whether I was In charge 
of .th^l^ss. In other words, I felt like the spokesman for 
a grdHkrather than- the person in control. By the end of the 
termlBBfcver, I felt quite comfortable about all this. 
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One RJight specuUte on a possible connection be-tween my tenseness 
and the students' lack, of response. Perhaps I conveyed to^them^ 
the idea that the c^s^ was a performance by me> and therefore 
they should not interrupt. * , 

* 

4. ,0n the other hand, Tdid fe'el more comfortable in this class about 

one thtng. Because of the existence of " the tutoring sessions, I 
didn't feel the need to make sure that everyone in the class under- 
stood a topic before moving on to the next one. 

5, The course was a bit slower in pace than usual, for the following 
possible -reasons: 

A, My beforementioned concern about proceeding vfery carefully.. 

8- Lack of response from the students made me feel they weren't 
"getting it"," 
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C. Feeling I was under scrutiny^made me want to make sure the 
V students made a good showing. 

' "0. The mechanics of the course: There were five tests, and there 
were also minor delays caused by losing the students the first 
'.>day, combining the' two sections, and one fire alarm. 

6. I spent a lot more time than usual on test preparation, test correc- 
tion '^especially trying to analyze the students' deficiencies) and 
on meetings with OLR people. 

7. In spite" of the fact that few students came to see me, as a result of 
the class, attention we paid to their performance, I am better acquaint- 
ed with these students than I am with students in comparable classes', 

C. MISCELLANEOUS 08SERVAT.IQNS - * 

1. I watched sever^hT of the tapes wi th •^Office of Learning Resources 
personnel. Their comnents were extremely helpful .in making me 
analyze my philosophy of teaching, and, in increasing my awareness 
of what is actually going on in the classroom. I was too nervous 
to try to change my habits very much in this particular class, but 

I did tend to practice new approaches in my other class, which was • 
much smaller and where my failures wouldn't be recorded, and the 
results were very gratifying to me. 

2. I was very favorably impressed by the way Ahmad worked with students 
in the math lab. 

3. I am mildly concerned that with all the attention we paid to the 
students who were not doing so well, we may have done less than 
we could for the really good ones. 
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On-fthe positive side, I think we can say at the very least that we 
made impossible for a fair number of students to accumulate a better set' 
o'f test scores than they normally would. I hope this means, that they have 
a firmer knowledge of the material and are consequently better-prepared 'for 
^^ubsequent courses, and I am cautiously optimistic that this is the case. 

the negative side, a disappointingly* large number of students simply 
propped out of sight. In fact, I would say that there seems to be a 
clearer than usual separation between the group of students who are in- 
volved in the course and those who ^ are not, and that this might be due 
mainly to the fact that we communicated to them that we cared whether 
they were involved or not. 
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EXTRACTS FROM 
TUTORS' COMMENTS 
AND OBSERVATIONS 

J0:150 . 
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II. OBSERVATIONS: ' . ' ■ 

It Is very important to coninunicate with those students who fail 
^. the diagnostic test andr to start Iniuedlately reviewing, pre-calculus 

material with them. \ ' • , ■ 

2. The diagnostic test should be geared towards the paterial we assume 
they know; material they will need,, throughout the course- > 

3. The first two; weeks are very Important,- Special effort should be 
made to make sure that "slow" students do not fall behind. 

4. Some students especially those .with language problems or a weak 
background In Math, should have special treatment- They need" 
more time tb catch up' with the class. 

5. Telephone numbers and addresses -of each student might be helpful 
In the process of conmunl cation. 

6. It Is very Important to face the students with their problems and 
the fact that they can get over their deficiencies. 

7. It Is very Important to face the students with their mistakes and 
with the fact that they should stop making them. 

8. It Is very Important to be friendly with the students and to show 
Interest In their progress. 

9. Students appreciate the extra help ava:11able, 122 students used 
the lab for periods of 1-3 hours. 

10. The lab In Its format provides the students with a pleasant atmos- 
phere to study mathematics on their own or with others or with the 
help of the tutor, 

11, It will be helpful to have the class away from Huntington Avenue 
which Is extremely noisy. 
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12. After a problem is solved or a definition Is written etc. it will 
be helpful if the camera person focuses on the blackboard so that 
slow students can catch up. 

13. It w11\ be extremely helpful to have a special videotape machine 
that enables the tutor to sto'p the tape with the picture showing. 

14. It is important to analyze the students' mistakes after each test 
to be treated in the lab. 

15. Some students don't have time for the lab (they work). 

16. Some students have the attitude that they are going to try school 
. for one semester. Others don't care about school to start with. 

17. It will be extremely helpful to assign 2-3 hours for math lab. This 
way all the students will be available for help or any activities that 
happen in the- lab. , • 

■ . 33 



III. RESULTS 
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1)5 to" the date of this report> every student who is still coming to class 
and to the ldb> is passing the course. Some of the students who showed ' 
up for the.labj consistently did extremely well, others did ok. 

The results of the make-up tests correlated with the students.' attendance 
in the lab. For the second and third, make-up tests, students who attended 
a review session on a certain topic did snuch better than those who did not. 
The same students did poorly on the .topics' they did not attend review sessions 
for. 

\ ... 
Some students dropped out of the course though th^y were doing well. Some did 
not have any hope of continuing (very weak math- background - needed to study 
a lighter course*)*. . „ 

In general, .1 think that the results were positive and a good number of 
students benefitted from the lab. 
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COURSE EVALUATION 



CALCULUS 10:150 



note: The following pages are extracted from an original, 
intferifn report generated for internal purposes. 
Only distributions of data are shown because, in 
' the original report, ease of interpretation by other 
readers was important. Means and deviations were 
originally computed but were not readily available 
for this paper. Data cards , however j, still exist. 
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RESPOHSES 
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CALCULUS 10:150 COURSE EVALUATION 

PART I instruction 



1 



65 
31 

0 

OMIT 



54 
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4 
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PACING (amount of materia! povered in relation to time available) 

a) too much material and not enough time 

b) adequate time devoted to each topic 

c) too much time devoted to each topic 

d) -pacing OK because the math lab was available, . -otherwise, ^a)* above 

CLARITY OF EXPLANATIONS (Prof. Filgo) 

a) instructor explained clearly and precisely f 

b) explanations were generally clear 

c) explanations were sometimes confusing .and difficult to follow 

d) explanations were often unclear and confusing 



QUALITY OF PRESEHTATION "(Prof. Filgo as a speaker) 

a) * extremely good. 

b) very good 

c) acceptable 

d) poor 



(providing organization and indicliting directions & 



4, OUTLINING MATERIAL 
emphasis) 

a) topics were clearly outlined. I k.new what to expect from each lacture. 

•b) topics followed an outlined seouence but I was unsure of their relationshios 

and emphasis until the lectures were finished 
c) outlines were rarely provided. I had no idea of where we were go-ing or 
how things fit together. 

5, OBJECTIVES (statements of what you would hav^e to be able to know or do at the 
end of .the class/course) . v 

•a) objectives were usually stated 

b) objectives were occasionally, stated 

c) objectives were, rarely stated 

d) objectives were stated but were unclear or unexplained 

6, NOTE TAKING 

a) I was able to take notes easily and attend to the lecture as well. 

b) I had to take notes so furiously that I missed parts 'of the lecture. 

c) I had a difficult time taking notes because I didn't know what to. stress, 

d) I rarely take notes so the above don't apply. 

e) • My note taking habits changed because 'I had additional resources ^'math 

lab; videotapes; tutor; etc) 

# 

7- 'Were the relationships a>id applications of calculus to engineering made clear fo 
you? ' 

a) regularly } 

b) sometimes 

c) rarely - ♦ 

d) this Is not important to me " ' • 

8. Choose the item below whith is closest ^to your ranking of factors affecting ycur 
performance in this course, y ^ _ ■ 



o 
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32 



RESPONSES 






% 




MOST IMPORTANT . 


• 23 • 


a) 


the Instruction 


12 . 


b) 


the Instruction 


35 


c) 


effort ability 


12 


d) 
e) 


effort & ability 


12 


subject 


8 


f) 


subject" 



rny effort's ability the subject' 
the. subject effort and ability 
instruction subject- 
subject. . . instruction 
instruction effort & ability 
effort & ability 'instruction 



PART 11 course design 



1. CONTENT (The difficulty of the subject as taught. do not consider the additional 
assistance when answering) 
0 a) much more difficult than most other courses I have taken 
27 b) ' somewhat more difficult ... ' - , 

42 c) about as difficult as most_. 

31 d) less difficult,., * * 

. 2. AMOUNt OF WORK (assignments. time spent studying, Include math lab time) 

8 a) much more work th^n most other courses I have - taken 

42 b) somewhat more ^ * - 

9^ c) about as much -work as most.,. - * 

^ d)" less work than most,., ^ ' ' 

* * 

3. TESTS -(the 4 tests taken so far) ' ' ' ' 
Choose the item below which best matches your feelinos about tests* 

81 a) level of difficulty was, OK and the tests covered "what- we were taught 
J-y b) tests covered what we were taught but were too long or toO hard 
0 cj tests did not cover w*hat^we were taught 

4, RETESTIHG I < ' ' ^ 
Choose' one of the following: 

69" a) I felt less anxious than usual about tests because I knew I would have a . 
second chance. " • 

27 b) The fact that retesting was possible did not lessen, my anxiety about testinc. 
OMIT = 4 • * 

RETESTING li " ^ 

Did you ever skip a test because you were n&t ready and you knew vou could take 
a retest? - ^ - • 

. 15 a) once. , . 

0 b) ^rnore than once , " 

85 c) never 

. 5. SPECIAL ASSISTANCE I (whether you used It or not) 

Choose the statement below which best matches your feelings about the special 
assistance available with this course. 
46 a) Any effort to provide extra help is worthwhile. 

b) The help available In this course reduces my anxiety about grades (even thouqh I 
may not have used it), . 

c) More effort'and resources should be devoted to programs aimed at students mo do 
well, 

SPECIAL ASSISTAMCE H * 

My feelings about the extra help in this course compared to other courses offering 

/ 

3V . 



50 
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RESPONSES 

24 
8 
4 



33 



20 
12 
32 
16 
12 
8 



28 
68 
4 
0 



20 
56 
24 
0 



8 
4 
28 

OMIT « 



40 
28 
12 
0 



extra help is that: ^ 

a) the program In this course Is mch more valuable 

b) the program in this course is a bit more valuable 

c) the program in this course is no better/worse than in other courses 

d) the program in this course is less valuable y 



6. Choose the item below which is closest to your ranking of factors affecting your per- 
formance in this course' ^ ' ' 



MOST IMPORTANT 

a) course design * my effort & ability 

(Including extra help) 
5) course design the subject 

(including' extra help) 
c) effort & ability course design 



■« * -t * 



d) effort & ability 

e) the subject 

f) the subject 



(including extra help) 
the subject 

effort^ & abil ity 

course design 
(including extra help) 



....LEAST IHPORTAHT • 
the subject 

effort &' ability 

"the subject 

course design 
(including extra help) 
course design* ' 
(including extra help) 
effort & a1>ility 



PART HI rapport (consider the class only) 

4 

1- Rate student-teacher rapport in this course 

a) " excellent 

b) good ' *• 

c) fair . . - ' ' 

d) poor . . ^ 

2. Rate student- student rapport in this course 

a) excellent - . • * 

b) good % . • " , 

c) fair 

d) poor 

3. Rate the availability of the instructor 

a) easy to reach/meet with 

b) sometifftes unavailaole 

c) difficult to reach/meat- with 

d) because of the extra help, I didn't feel the need to contact the instructor often 
4 (or at all ). 

4. Did the instructor seem approachable, that is, did you feel comfortable talking with 
him, asking questions, etc? 

a) extremely approachable 

b) very approachable 

c) some what approachable 

d) not at all approachable 

5. Did the instructor seem interested In his students, their progress, and their 
problems? 

56 a) extremely interested 4 
36 b) very interested 

8 c) some what interested 

0 d) not at all interested 



ERIC 
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RESF0«$£S6. Choose the item below which is closest to your ranking of factors affecting your 



% 



16 

28 
32 
12 
12 



performance in this course 

MOST IMPORTANT.,.,... 

a) rapport 

b) rapport 

c) my effort & ability 

d) my effort & ability 

e) subject 

f) subject 

PART IV ^general questions 



my effort & ability 

subject 

rapport 

subject 

effort & ability 
rapport 



...LEAST IMPORTAri'T ' 

the subject 

my effort & ability 

subject 

rapport 
•* rapport 

ef.fort & ability 



4 

96 



12 
44 
44 



36 
64 



1. Did the presence of the television^ equipment inconv 
anxiety? 

a) yes 

b) no 




nee you or cause any 



36 
4 

OMIT = 60 



2. Did you ask questions in class? 

a) often ' ... 

b) sometimes • ^ * *. ' - * 

c) rarely - " ^ 

*X * - 

3. Did the fact that extra help was available chajige your question asking habits? 

a) yes \ 

b) no - » 

3a. If yes, how? ^ 
a) fewer questions 

b*) more questions . I " 

4. Choose the item below which is closest to your ranking of factors affecting your 
performance in this course 



HIT 



48 


a) 


12 


b} 


8 


cl 


20 


d) 


0 


e) 


8 


f) 


= 4 





MOST IMPORTANT.......... 

instruction' 

b} instruction 

course design 
(including extra help) 
course design 
(including extra help) 
rapport 

f) rapport 



course design 

( includlng^extra help) 

rapport 

rapport 

instruction 

course design 
(including extra help) 
Instruction 



.LEAST IMPORTANT 
rapport . 

course design 
(including extra help) 
instruction 

rapport 

Instruction 

course design 
(including extra help) 



40 
20 
12 
12 

41 6 



MATH LAB EVALUATION (fill In if you ever used the math lab for any reason) 
PART I general Questions 

1. About how many times did you use the math lab? 

a) . " 

b) 4-8 

c) 9-13 

d) 14+ . 



'% 2. i^hy did you most often use the math lab? , ' ' 

'g ai) to review classes , • , ' , . ^ 

23 b) to study for tests 

$Q c) to study for tests , • - 

19 d) to seek additional information on any top1c(s) . 

3, What methods/materials did you most often, use? ' . ' _ 
36 ^) Instruction by tutor 

55 ' tutor and videotape, instruction i 

0 c) videotape alone * 

5 d) additional materials (including problems) . . ' 

5 e) student study group • ' ' " , - 

4. What is your general estimate of the V^lue of the math lab? 
52 a)- extremely valuable . ' ■ 

38 b) very valuable 

5 c) somewhat valuable , , 

5 . d) not at all valuable ■ ■ _ 

5, What is the value of the videotape/tutor method us^d In the math lab? 
38 a) extremely valuable ^ • ^ 
52 b) very valuable ' •* 

5 c) somewhat valuable . " 

'5 d) not at all valuable , • . 

6. What is the value of the videotape without the tutor? 
5 a) extremely valuable 

38 b) very valuable ' . 

38 c) some what valuable 

14 , d) not at all valuable 

OMIT » 5 . , 

PARI n - the tutor . • 

1. Old the tutor establish a non- threaten 1«ng (helping) relationship in the math lab? 
76 .a') very much so 

19 b) to some degree . . 

5 c) not very much 

0*^ d) was very authoritative and threatening 

> 

2, Did the tutor seem to have a solid knowledge of the subject 

a) . very knowledgeable 

b) somewhat knowledgeable 

c) not very knowledgeable • . . " 

Did the tutor explain clearly and precisely ? 

a) almost always 

b) often 

c) sometimes 

d) rarely 

4. Did the tutor use the resources available (that Is TV, pterials, etc.) or did 
he simply lecture? 
81 a)- used resources often 

19 b) used- resource^, occasionally 

0 c) used resources rarely 

0 d) most often lectured 




o 

ERIC 



4'* 



36 



.% 
, "67 
24 . 
10 
0 



•7^ 
24 
0 
0 



67 
33 
0 
0 



^24 
* 71. 



23 
27 

0 
'.5 

0 

OMIT - 

5 

76 
, 14 
OMIT = 



5. Was the tutor able to understand your question or problem' 
. a) almost always 

-b) often \ . 

c) occasionally . * 

d) rarely 

6. Was the tutor able to help you solve your problem or atiswer your questions? . ■ 

a) almost always • Mu^^viuui*. ^ 

b) ^often ' ' 

c) "occasionally > "* 

d) rarely " ' - , 

^' ■act^itiSf'^ ""^^^ lab instruction and activities to class Instruction and 

a) almost always • , 

b) often ' • ' 

c) occasionally 

d) rarely 



PART .III 



administration" 



45 
3, 



Did you resent efforts made to get you to use the math lab 

a) very much . • 

b) a bit ' - * 

c) I had no such feelings « . ' 

^hal'^you^neSefLipr '''"^ ""''^ ^^^^'^ '^'"^ ^'"^^'^tions 

a) I usually work out my own problems , 

,b) T had no time - . ' \ 

c) I didn't like the tutor , V 

d) I didn't likevheinq oressured ' 

e) other (please rist) ' (NONE listed) 

Op you consider that the math lab: 

a) k;,ept,you from failing . < 

b) helped you raise your grade _ * 

c) made little differently to your performance . * 



o 
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COMBINED DATA OF TV 1 CLASSES,^ 



• 10:151 



4k 



note: mean scores and d i s t r i ba 1 1 ons of scores a re ' presented 
for all I terns* * . , , on thos^ items In which tihe mean 
score is underlined, the distribution of scores is the 
more accurate representation of the data" 
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( CALCULUS COURSE SyAlUATION 

PART I instructiofi 



K PACING {momt of matenal covered in reUtlon to time ivalUbU) 

2.00 26 4 J too inuch material and not enough time 

^o" bj 4de<^yate time devoted to each topic ^ « 

I c) ■ too much time devoted to each topic 

.\ 13 d) pacing OK because the math lab was available... otherwise, a}* above . 
} 

2. ClARITY OF EXPLANATIONS <y<5«r inscruccor only ...not your tutor) 
2-3^7 28 a) Instructor explained clearly and precisely 

26 b) explanations were generally clear 

29 c) explanations were sometimes confusing and difficult to follow . 

17 ' 4) explanations were often unclear and confusing 

3. qUALITY OF PRESEHTATION (your inscrucljor's ability «• « «p«ak«r) 
2.^31 2 J a) extremely good 

28 b) very good ' . ' • 

39 c) acceptable 

13. d) poor 

4. OUTLIHIHG HATERIAL (providing organization ^nd indlciting directions ^ 

K625 ^0 a) topics were clearly outlined. I knew what to expect frm etch lecture. 

57 b) topics followed an outlined sequence but I was unsure of their relationshi 

and emphasis until the lectures *were finished 

3 c) outlines were rarely provided. I had no Idea of where we were ^olng or 
how things fit together. 

5^ OBJECTIVES, (statements of what you would have to be aWe^to know or do at the 
end of the class/course) 

• 56 a) objectives were usually stated * ' 

31 b) objectives were occasionally stated 

}Q c) objectives' were rarely s^tated 

^ d) objectives were stated but were unclear or unexplained 

6. HCTE TAKIHQ 

^■833 5J ^a) I was able to take notes easily and attend to the lecture as welK 

- 28 b) I had to take notes so furiously that I missed parts of the l^cture^ 

10 c) 1 had a difficult time taking nlrt:es because I d1dn*t know what to stress. 

8 . ^) J rarely take notes so the above don*t apply. 

3 e) My note taking habits changed because I had addttlonal resources (math 
lab; videotapes; tutor; etc^) 

?> Were the retationships "and applications of calculus to engineering made clear 
you? 

^ - 8q8 33 ^ ) regularly 

5o b) sometiines 

^ ' c) . rarely 

^ d) this is not important to me 



^3 
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PART ir course design , 
8. 



* COMTEHT (The difficulty of the subject as taught.,. do not consider the -additional 
assistance xhen answering) 
2.338 21' a) much moi^e difflcwlt than roost other courses I have taken 
37 b) somewhat rnoce difficult ... ' • 

30 c) about as difficult as most.?. ■ 
O d) less difflcuH... 

9- mmi OF WORK (assignments... time spent studying.,, ii^clude math lab time) 
2.35 ^'^^ '^^^ ^"^^^ other courses I have taken 

b) somewhat swre ... ■ • ' 

35 c) about as much work as most, 
7 d) less wrk than most... 

10, TESTS tests -tak^n so far) " • 
Choose the itan below which best watches your feelings about tests: 

1.37 (>k a) level of difficulty was OK and the tests covered what we were taught 
3M tests covered what we were taught but were too long or too hard 
1 c) tests did not cover what we were^taught 

11, RETESTING 'l ' ' ■ " 
Choose one of the following: 

l-.3J^ 71 a) 1 felt less anxious than usual about tests because I knew I would have a 
,* second chance. • '♦^ >. , ' ' 

■ . ^ 28 b) The fact that retesting was possible did not lessen my anxiety about testing, 

^«Iiv 12. .RETESTING II ^ ^ 

. Old you ever skip a test because you were not ready and you knew you could take 

I' a retest? 

2.63 17 a) once 

3 b) more than once ^ - 

80 c) never " ^ 

13. SPECIAl ASSISTANCE I (whether you used it or not) 

Choose the statement below which best matches your feelings about the special 
assistance available with this course, . a 

»-30 77 a) Any effort to provide extra help is worthwhile, 

15 b) The help available in this course reduces my anxiety about grades (even though I 
may not have ""used it), 

5 c) More effort and resources should be devoted to programs aimed at students who do 
well, 

14. SPECIAL ASSISTANCE II . ^ . 
My feelings about the extras help in this course compared to other courses offering 

^ extra help is that: 

\AZ 70 a) the program In this course is much more valuable 

20 b) the program in. this course Is a bit more valuable 

* , .9 c) the program in this course Is no better/worse than In other courses 

I d) the prograip In this course is less valuable 



ERIC 



7 . ^.^^^^P^' rapport (consider th« class 'only) 

, Student-teacher rapport In this course 

2.32 24 a) excellent. 

35 b) good 

31 c) fair 

'0 d) poor 

2 00 10^*-^?^* student-student rappprt in this course 

/.oo 19 5j excellent 

b) good 

'3 ^) fair , ' ^ • 

' d) poor ' * • 

t 

1 availability of the Instructor 

i2f ^° a} easy to reach/ineet wHh 
b) some times iinava'fl able, 
^ c) difficult to. reach/fneet' with 



; '[ (oT^r.fu!"' ' ''^^"•^ '0 "„t«t th, instructor often 

■ ^ f«> P-fortable taUIn, 

a)'e>ctreme1y approac}iab1« 
^/ b) very approachable > . - 

^- c) some what approachable 

* d) not at all approachable . , ^ * 



19.0id the instructor seem interested M> hi-? c^-.,^a«>^ ^ 

problems? ' ^'"^ students, their progrt.'s, and thefi 

2Atf 12 a) extrauely interested ' • 
28 b) very interested ' „ 

39 c) some what interested 

d) not at all int^r^^t^4 " " 



F n go 
On } Y 



PART IV general questions 

'"'"xleSt""""" °' t«'«vU1on equl^nt InconvenUpce you or caus, any 
a) yes " * ' 

. ^ '00 5j no : • 

(10?15X) 

21. Old you asJc questions in class' 
2.-35 12. a) often ^ " . 

^2 b) sdroetimes 

^ c) * rarely > ^ ^ 

«.D« t^e f«t t^,fr«tra telp was ava.lab,. change your question asMng haMtsJ 



K73 33 a) yes 
M b) no 



23, If yes, how? 
83 a) fewer questions 
<7 b) more questions 



FRir 
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MATH UB EVALUATIOH (fH, i„ if ^ „^ ^^^^^ 

PART. I general <|ufist1ons 



30 
17 
8 



2,^2 21 

17 
23 



25. 



About how many times did you use th« math Ub? ' 

b) M 

c) 9-13 

d) 14+ 

Why did you most often use the math lab-? 
aj to review classes 
h) 0o study for tests 
C) to study for re tests 

<i) to seek additional information on any topic{s} 



a; instruction by tutor 

b) tutor and videotape instruction * - 

c) videotape alone * 

b) very valuable 

c) somewhat valuable 

d) not at all valuable 

a, a, T.ll^^fdlT "-^-''P*/*"*- -thod used in the n-at/UM 

b) very valuable 

c) somewhat valuable 

d) not at all valuable 



13 
0 

d 
a 



19 

2 



28 

n 



3. 18 



29, 
2 

7 
6) 

30 



b) very valuable 

c) scroe.what valuable 

d) not at all valuable 



PART n the tutor 



3Q. 



J. 17 85 
13 



31, 
1. 10 30 
10 



lY «r/S ^ """-'T^tening (helping) r.Utlo„.hip In the «th lab? 

b) to sane degree 

c) not very much 

<*} vas very authoritative and threatening , * . ' 

aT ve'ry^a^SglabV^ ^ ^^^^'^ -^i-t 

b) -^ somewhat knowledgeable 

c) not very knowledgeable 



ERIC 



Y X 

' 32, otd the tutor explain clearly and precisely ? » 42 

1.26 77 a) Almost al><ays 

19 b) often 

h c) scroetimes • . • * 

0 d) rarely 

, -<» 

33. Did the tutor use the resources available (t.hat Is TY» fnaterials» etc.} or 

simply lecture? . " ♦ 

2, ii2 32 a ) used resources often 

28 b) used resources occasionally * 
6 c) used resources rarely 
3^ d) most often lectured' 

34. Has the tutor able to und^^rstand your question or probl^em? 
K58 75 ^Itnost always 

21 bj often * 
h c) occaslonalTy ' ^ ' 
0 d) rarely " ^ * * 

35. Was the.tutor able to help you solve your problem or answer your questions? - 
K 30 75 • a)* almost always 

13 b) often 

$ c) occasionally ♦ 

0 d) rarely . ' > 

36. Did the tutor tie In math lab instruction and activities to class .Instruction and 
activities? 

].kk 64 a) almost always 

30 b) often > 
c) occasionally 



) occasionally / r* 

) rarely / \ 



2 d 

PART III administration 

37, Old you resent efforts made to get you to use the math lab 
2,83 0 a^) very imjch , . 

J8 b) a bit ^ 

c) I had no such feelings 

38, Would y^^ specify your reasons for not using the math lab (If there were' indication 
that 'you needed help). 

> >50 32 a) I usually work out my own problems 

55 b) I had no time ^ 

S c) I d1dn*t like the tutor 

3 d) I didn't like being pressured 
3 e) other (please list) 

39, Oo you consider that the math lab: 
^ - 9^ '"^) kept you from falling; 

. 55 b) helped you raise your grade 

c) made little difference to your performance 
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COMeiHEO DATA OF NOH-TV! CLASSE'S 
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note: mean scores and distributions of scores are presented 

for an items on those items in which the mean score 

is underlined, tfie distribution of scores i*S the more, 
.accurate representation of the data - / 
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.CALCULUS • COURSE EVALUATION 

PART I Instruction 

* K PACING (amount of material covered In relation to time available) 
12 a) too much materi.al and not enough time ' " V 

87 b) adequate time devoted to each topic ^ , / 

J c) too much time devoted to each topic • j-*"^- 



2. CURItr OF EXPLANATIONS 

31 a) Instructor explained clearly and precisely 

57 b) explanations were generally clear 

!0 c) explanations 'were sometimes confusing and difficult to follow 

i d) explanations were often unclear and confusing 

3. QUALITY OF PRESENTATION ^our Instructor's ability as a speaker) 
13 ' a) extremely^ good . 

56 b) very good * . _ . * * 

2^1 c) acceptable 
I d) poor . * ^ 

4v OUTLINING MATERIAL (providing organization and indicating directions & 
ernphasis) 

52 a) topics>^were clearly outlined. I knew what to expect from each lecture. 

ii3 b) /topics followed an outlined sequence but I was unsure of their relationships 

and emphasis until the lectures were finished 
5 c) outlines were rarely provided. I had no idea of where 4fe were going or 

how things fit together. 

5, OBOECTIveS (statefTients of what you would have to 5e able to know or do at^ the 
end of the class/course) ^ 

52 a) objectives were usually stated * 

31 b) objectives were occasionally stated 

16 c) objectives were rarely stated 

0 d) objectives were stated but were unclear or unexplained % 

6. NOTE TAKING. 

a) I was able to take notes easily and attend to the lecture* as well. 

iy b) i .had to take notes so furiously that I missed parts of the \ecture. 

7 c) I had a difficult time taking notes because I didn^t know what to stress, 

18 d) I rarely take notes ^ so the above don*t apply,* 



♦ • ' it 

7. Were the relationships and applications of calculus to engitieerlng made clear to 

you? 

3} a) ^ regularb 

58 b) sometimes ^ x 

3 c) rarely ' 

2 d) this is not important to me 



<!.9 
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PART n course design 

^ 8. CONTENT {The difficulty of the subject as taught.) 

X " z 

3.012 3^) ^^^^ difficult than most other courses I have taken 
20 i>) somevihat mofe difficult 
• ii^c) about as difficult as most... 
2*8 <1) ^^ss difficult*.* . , ' 

5- AMOUNT OF WORK (assignnients.* • time spent studying,) 
2.895 1^^ ^^^^ ^^^^ other courses I have taken ^ 

27^) somewhat more ...^ 
5 J c) about as much work as most- . . 
^8<i) ^«ss work than most.^. 



1 . U3 



10. TESTS ( tests taken so far) 

Choose the itenr below which best maxcnes your feelings about tests: 
85 a) level ot difficulty was OK and the tests^ covered what we were taught 
|i, b) tests covered what we were taught but were too long or too hard 
I c) tests did not cover what we were taught 

PART III " rapport (relationships vith other people) 

» . 11. Rate student-teacher rapport in this course 
K788 36 *) excellent 
53 b) good 

6 c) fair - \ 

" 5 d) poor - , 

12 

^Rate student -^student rapport in this course 
2.I85 15^) excellent 
Sk t>) good * 
28 fair 

2 d) poor ^ 

l^^Rate the availablli'ty of the Instructor 
2, 5U 39 ^) «asy to reach/meet with ' 
)h b) soroetiifies unavailable 
2 c) difficult to reach/meet with 
d) I didnH feel the need to contact the instructor often. 

"■£11 «klSr;u«?^re??r'''''"'' c«forUble Slicing «ith 

1.869 37 a) extremely approachable. 
^0 b) very approachable 
21 c) somewhat approachable 
I d) not at^all approachable 

15. Did the instructor seem Interested in his students, their progress, and their 
problems? » 
1.82} 32 a) extremely Interested 
^ 5^ b) very interested 

U <=) somewhat interested 
0 d) not at all Interested 
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SURVEY 
^10:152 

mean scores, deviations, and distributions of scores 
are presented for all item's on those 'Items In 
which the raean score Is underlined, the distribution 
of scores is the more accurate representation of data 
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COURSE EVALUATION CALCULUS ^ 0:1 52 J 

CAUCUIUS COURSE EVALUATION 

PART I instruction 
% 

1. PACING (amount of roaterial covered in relation to time available) 
^ ^ 1^2 a ^ too much material and not enoygft time 

7i i n adequate time devoted to each topic 

iiZi 6c} too much time devoted to each topic 

24 d) pacing OK because the math lab was available, , .othen^lse. *a)* above 

2. CLARITY OF eXPLAHATIOMS C/our instructor only . . .not your tutor) 
65 a) instructor explained clearly and precisely 

1-35 «49 35 bj explanations were generally clear 

— c) explanations were sometimes contusing and difficult to follow 
— ■ d) explanations were often unclear and confusing 



3. QUAIITY OF PReSEMTATION (your instructor's ability a api^aker) 
71* a| extremely good 



2 A b) very good 

1.35 .60 6 c) acceptable 

— d) , poor 

% OUTLINING MATERIAL (^providing organization and Indicating directions S 
^ipha-sis) . 

41 a) topics were clearly outlined, I knew what to expect from each lecture. 
1.70 * -68 topics followed an outlined sequence Out I was wsure of their relctlonsbl 

— ^ — * and emphasis until the lectures wefe finished 

12 c) outlines were rarely provided. I had no idea of where we were going or 
;^ - how things fit togethef^ 

* ♦ > ** ^ 

5. OBJECTIVES (staten^ents of what you wquld have to be able to know or do at the 
^nd of the class/course) 

59 a) objectives were usually stated ' . ^ 

1.47 .62 . ' 35 b) objectives were occasionally stated ^ 

6 c) objectives were rarely stated 

d) objectives were stated bat were unclear or unexplained 

6. NOTE TAKING 

88 a) I was able to take notes easily and attend to the lecture as well, 
*6 b) I had to taKe notes so furiously that I missed parts of the lecture* 
'75 — c) I had a difficult time taking notes because 1 d1dn*t know what to stress, 

6 d) I rarely take notes so the above don^t apply. 

— e) My note taking habits changed because I had additional resources (math 

lab; videotapes; tutor; etc.) 

7. Were the relationships and applications of calculus to engineering made clear 
you? 

35 a) regularly 
59 b) sometimes - 
6 c) rarely- 

1^78 .58 — d) this is not in-.portant to me 
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PAP.T II course design 
Y* 

8. CONTENT 



CONTENT (The difficulty of the subject as taught,., do not consider the additiona 
assistance when answering) , ^-le aoo^xiona 



-~ a ) much more difficult than fnost other courses I have taken 

lo b) somewhat more difficult ... 

65 c) about as difficult as roost... 

18 d) less difficult... > 



V? ^^llrt^I^^^ (assignments... time spent studying.. .include math lab time) 
a) much roor? work than mo,st other courses 1 have taken ^ ^ 

24 0 ; somewhat more . . . 
41 c) about as much work as most... 
24 d) less work than most,., * • . 

10. TESTS tests taken so far) 

Choose the item below which best matches your feelings about tests ♦ 
fi K f^^!^ difficulty was OK and the 'tests covered what v.^ were taught 
18 b tests covered what we were taught bul were too long or too hard 
— c) tests did not cover what we were taught 

A. RETESTIN6 1 • ■ ' . 

Choose one of the following: 

^^^^ Lcond chanc-"^^^"^ ''^'^^^ ^^""^ ^^^^^ because I knew I would have a 
35 b) The fact that retesting was possible did not lessen my anxiety about testing. 
12, RETESTING U 

a'relestr' '^'^ ' ^"^""'^ ^''^ ^^''^ "''^ ""^'^^ ^^^^ take 

-29 a ) once . 

6^b) more than once ' X 

65 c) never / * 

13^ SPECIAL ASSISTANCE I (whether you used it or not) 

Choose the statement below which best matches your feelings about the 5DPri;,i 
assistance available with this course. ^ special 

llil J"^-«^"f^*"t to provide'extra help is worthwhile. 

' ITy XVllll'ill''''' -"".^ tho„9h I 

10 U^re effort resources should be devoted to programs Jimed at students „ho do 

U. SPECIAL ASSISTANCE It 

Hy feelings about the extra help In this course compared to other courses offerln, 
extra help is that: *^<»eiuiy 
5^) the program in this course. is much more valuable 
the program in this course is a bit n^ore valuable 
^ A th! f this course Is no better/worse than In other courses 

the program in this course is less valuable courses 
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1,70 .68 47 b) good 
12 c) fair 
— d) poor 



PART !l! ' rappori (consider the class only) 

IS, Rate student -teacher rapport In this course 
Al 4} excellent 



16. Rate studeht-student rapport in. this course 
24 a) excellent 



1.58 ,79 



1.64 ,49' 



1.70 .47 



2.0 .720 53 b) good 
24 c) fair 

— d) poor 

17-Rate the availability of Ihe instructor 
i) easy to rgach/rneet with 
r.81 1.32 , 6 ^) sometimes unavailable 
• — c) difficult to reach/meet with 

■ ■ " (r"ra?f)^''= ' th. „.ed to 'contact the instructor ofte, 

59 a) extremely approachable . ' ' ' 

24 b) very approachable * ' 

18 c) some what approachable . * 

— d) not at al> approachable ,^ > 

' 19-Oid the -instructor seem interestAd in hi<: ci-„H^„+^ i-u t 

problem^? \ ncerested m his students , their .progrt.'s, and their 

35 a) extremely interested 
65 b) -very interested 

— c) some what interested \' - 
— d) not at all interested 

4 

PAKT IV general questions 

anx;e?y?'''''''' television equipment inconvenience you or cause any 



-r—- 100 b) no 

21. Did you ask questions in cUss^ 
6a) often 

2.41 .61 47b) sometimes \ 
•47c) rarely • . ^ 1 



22^Did.the fact that extra help „« „anab,e change your ,„«llo„ asMrig habits' 

71b) no 



23. If yes^ j^oy^? ^ ^ . , 

^ f. f. 10(?) fewer' questions 

tlZ " -^) more questions (n»5) 



LAB EVALUATiOH (fill ir if you aver used the math Ub for any reason) 
PART I general questions 

24, About how many times did yoo use the math lab?" 
57 a) 1-3 
29 b) 4-8 

14 c) 9-13 • ■ , ^ ■ 

— d) 14+ 

•25. Why did you most often use the math Ub? 
14d) to review clashes 

36b) to study for tests - 
50c). to study for re tests 

-^d) to seek additional information on any topic(s) 

26* What methods/inateriafs did you most often use? 
64a) instruction by tutor ; * 

21b) tutor and videotape irfstructlon 

7c) videotape alone . . ^ 

7d) additional materials (including problems) 
^ — e) student study group ^ , ^ • 

27.. What is your general e'stimate of the value of the math lab?- 
50a) extremely" valuable • - ^ 

36b) very valuable 

14c) somewhat valuable . ^ ^ ' 

— d) not at all valuable 

20. What is the value of the videotape/tutor method used In the math lab^^ 

50^) extremely .valuable . ' ' 

• 36"b) very valuable, . * » 

14 c) somewhat valuable . - 

--4) ,not at>an valuable, 

■» - ' , 

29. V.'hat is the valae of the<?videotape wifhout the tutor? 
% 2ia) extremely Valuable 

7 b) very valua^ble ' . ' 

64 c) some what valuable > 
7d) not at all- valuable ■ 

PART n tfie t^Jtor 

^^'86 a)"^ Jery^S ^^^''^ ' non- threatening (helping) relationship In the math,1ab? 
14 b) to some degree , *" . 

— c) not very much ' ^ • 

— d) was very authoritative -and threatening" 

Did the tutor seem to have^^a solid knowledge of the subject 
93 ^} very knowledgeable j . o ^ 

7b| somewhat knowledgeable 
— c) not very knowledgeable - - 



X ^ SD 32. Oicl the tutor explain clearly and precisely ? ^ 

64 4) almost always ^ . 

1.35 .49 3^ o^ten * " " . ^ _A 

— c) sometimes ' . < <1 
d) rarely ^ ^ 

33. Did the tut'or use the resources avaiUble (that Is TV, uiaterlals, etc.) br 

simply 'lecture? ., -J 
v62 ^) used resources often . * 

X.^A 1.21 8 b) U5ed resources occasionally 

• 15 c) . used resources rarely ' * . • 

^ <i) roost often lectured . , . " 

34. Was the tutor^able to understand your question or problem? , 
85 a) almost always » >' \ ■ ' 

1.15 .37 ,15;t) often ' 

— c)" occaslonallyA . 

— d) rarely 

35. Was the. tutor able to help you solve your problem or ansWer your questions? 
92 a) alsjost always 

1.07 .277 8 b) often , 

— c) ■ occasionally • - 

— d) rarely , 

• " ' ,^ ' * 

36. Old the tutor .tie in math lab Instruction and activities to class Instruction and ' • 
. activities? . . . 

, ''a) almost always 

1.46 .96 8 b) often 



2.57 .75 



8 c) occasionally , 
8 d) rarely , * . 

PART ni administration 

37, Old you resent efforts roade to get you to use the math lab 
14 a) very much 
14 b) a bit 

71c) I had no such feelinas 



1 



38. vio'uld you specify your reasons fof not using the math lab (If there were indication 
that you needed help), l- 

36 a) L usually work out mv own problems 

55 b) I had no time ' " • * 

1^ 1,13 _c) I didn't like the tutor " ^ 
— d) I didn't like being f^ressured . 
9 e) other (please list) 

t 

39. Do you consider' that the math lab: 
14^) kept you from failing 

2-14 57 b) helped you raise your grade ^ ' • 

29 c) made little difference to your perfomance ' 
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PERFORMANCE OF SELECTED STUDENTS IN CAICUIUS 10:150 



CT 



80 
Ti 



eo 



60 
T2 



60 
R2 



60 
T3 



60 
R3 



i20 
T4 



120 
R4 



GRADE 



S3 



13 



6 3 b- 



S5A 



S7A 



93 . 5B- . 94B 



84 . 5C 



& 



52 



18 



73A- 



33. 5D 320 



26,5F+ 41. 5C 



58D- 



56. 5D 58F 



33 



12 



59C+ 67B 



48B 



57A 



53.5F+ 74. 5C- 740 



C+ 



35 



16 



52C- 62B- 



300- 45.5B- m 19G+ 



33C- 



600^ 



C- 



24 



46 



10 



22 



67B 



67B 



35.50 45B- 



4? , SB 



36. 5C • 46B- 



49-. SB 



7 3C- 



71D+- 



77 



83.5C+ 87. 5C 



B 



— Increase in grade 



decrease In grade' 

OT = diagnostic test 

CT = calculus pre- test 

TI = test 1; Rl = ret^st li etc, 

FIN = final exam 
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CALCULUS 10:150 test retest results 

^ ■'"^r-«3se.- 38 decrease = 8 no chanqe = 3 

" ' 1 = test.l; 1R = retest 1; etc. 

arrows indicate direction of 

retest results ,^ 
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CALCULUS 10:151 test / re test results 

increases =64 decreases = 4 
no change = 6 

1 = test 1; IR = retest 1; etc". 
arrows indicate direction of 
retest results 
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AOaECTIYE RATING "sCALfe 
FACTOR STRUCTURE ' 
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FACTOR SYSTHI FOR m ADJECTIVE RATING SCALE 



scale 
worth 



item 



'informative 
enlightening 

good 

worthwhile 

necessary 

practical 

valuable 

rewarding 

relevant 

useless 

dull 

a waste 

bbring 
irrelevant 



scale mean 
1,935 



al pha 
.944 



cognitive 
appeal 



interesting 
enjoyable 
exciting 
stimulating 



difficulty 



difficult 
demanding 
challenging 



provocativeness 
difference 



2.30 



2,72 



•2.7 
. 2.83 



,754 



,723 



COGNITIVE 

APPEAL 
(AFFECT) 



WORTH 



.1 



^ AOJECTIVt RATING SCAl^ PROFILE 
Exfwnely Vtry ,Somewhot 



T 



T 



Nof>e ait oil 



' .1 2 3 i' • 9I I ■? '3 4 I 6 '7 I 9 1 j '2 j .4 ' .6 7 8 >l 

10 15 20 25 3.0 35 4.0 



4 



*T — ^ — ^ — ^-- ^ ♦ f r 



• I ' • ' ' 1 



1 



MEAN 
SCOftE 



2.30 



1.93 



DIFFiCU LTY 



V 



' I f f * f I ' i » y 



2. 72 



OTHER 



PROVOCATIVE 

I I 

DIFFERENT 
}0:i5O 



Course - 

Instructo r filgo 



Dolt Collected 



7/ 19 



— h 



I 



1 



2:70 
2,83 



Group Size — ^ ^ ^ . 

Qmm (or kttnictioM D»»tlopn»i» 



COMBINED TV I AHV HON-TV J 
»'ADJ£CTtVE RATING SCALE*' 
FACTOR STRUCTURE 

10:151 



ADJECTIVE RATING SCALE 

FACTORS (1)' 



Scale I(Interest) Scale ll (Worth) Scale til < D i f f i cu 1 1 y ) 



interesting 
i n f orm^ t ijA/e 
enlightening 
enjoyable 
exciting 
stimulating 
pr o voca ti ve 
good ^ 
rewarding 



wart hwhi le 
practical 
valuable 
r,e 1 e V a h t 
useless 
dull . - ' - 
a was i\ 
boring 
irrelevant 



difterent 
tli f f i cul t 
(lemandi ng 
challenging 



^ Ik 



a_lpha= ..890 
X = 2;58 

(1 ) >i=i 1 1 



alpha = , 86 2 
X=K76 ■ 



a^lpha= . 80 2 
X=2.H7 



c » 
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en 



AOJECTIVE RATIH6 SCALE PROFILE 



worth 



Exfremety 

*~T 



Very 

' — r~ 



Somewhat 





None o\o\\ 



' j '2 '3 'S'l 8 .9 1 J 2 :3 'a I « > A 9^ ') '2 .'3 'H^lbJ 

10 15 2.0 25 . 3.0 33 4.0 



f ■ P 'f 1 ? y ■ r 



-* » r— T 1 », r 



I ' — ' — ' I ' ' — ' — ^ 



alpha 



1.78 . 86-2 



inter e*st 



■^ r f y » 



difficulty 



f T I ?' 'r- 



1^ ' ■ ■ 1 



I ' • ' • I 



1 ■ ■ ^ 



-IP — r — I 1 f — » ' r 



2.58 . 890 



r 

2 . H7 . 802 



' — ' i ^ I ^ i I t f' > f t I ■ ^ f 



^ combined tvi/no-tvi _ 

course Group Size, 

Instructo r 



1 1 1 



Dofe Collected ^iec, 197 8 



© Edwofd E Ktlly 

Center lor Instrncttonoi Dtv«topm*nt 
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ADJECTIVE RATING SCALE 
FACTOR STRUCTURE 



10:152 



7.; 



ERIC 



ADJECTIVE RATING SCALE F.ACTORS 
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SCALE 

INTEREST/ 
AFFECT 



WORTH 



NEGATIVE 
ASPECTS 



DIFFICULTY 



ITEM . 

INTERESTING 
ENJOYABLE 
EXCITING 
GOOD 

REVIAROING 

INFORMATIVE • 
WORTHWHILE 
NECESSARY 
PREATICAL 
VALUABLE 
t RELEVANT 

USELESS 
DULL 
A WASTE 
BORING 

irrelevant 

difficult 
demanding 
challenging 

provocative 
"different 

enlightening 
stimulating 



SCALE MEAN 
2-40 



U81 



3.60 



2.44 



3.11 
2.47 

2.52 
2.82 



ALPHA 



784 



.863 



.814 



.741 
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Extremely 
~T 



ADJECTIVE RATING SCALE PROFILE 
Very ' ■ Somewhat 



None at all 



T 



X 



latere sty ' f 
affect 



+ 



1 2 .3 A^6 7 '.8 .9+ .1 ,2 3 A 

10 \ 15 2.0 2.5 



y ' f V T I 9 r * 



3.0 



33 . 4.0- 



#onth 



1- 



"T f ■ T 



, V. 



-| J f 1 1 1 1 III 1 I » TT-"' 1 1.81 



alpha 



I , , . . I . . ■ . I . ■ . » I 2 . H 0 7 8 % 



.863 



negat i ve 
aspects 



I ■ 1 



— — y p — y^ 7 I T I I 



r —T — r — I — r" — f ^ 



i 3.60 .en 



difficulty f- 



V J 

^ ^ r^-j w w P 1— ? -1 » « 1^"? ' ? » 1 



2 



7m 



, other 



T— t » ' ? y t y — ■ T ' - y i * f 



-f r 



Course — 
Instructor. 



10:152 



F i 1 go 



Date Collected 



Group Size. 



n = 31 



(c) Ed word F Kdly 

Center Jof InitriKtionol Oevelopm«of 
Syirocuse Uni versify 

19.75 .1 . 
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^ COMPARATIVE RANKS OF ATTRIBUTION ITEMS 
FOR 10:151 TVI, 
10:151 NON-TVI, S 10:152 



ERIC 



RANKS OF ATTRIBUTION ITEfIS 



ITEM 



10:151 TVI RANK 
(n = 24) 



10:151 NON-TVI RANK 
(n = 87) 



10:152. RANK 
(n - 31) 



subject difficulty. 

personal effort 

the classroom 

performance of 
other students 

personal ability 
Iff 

course design 
(excluding extra 
assistance) 

personal moods, 
physical con- 
dition etc, 

available extra 
assistance (TVI) 

luck 

instructor 
personality 

instructor 
teaching ability 

tutor personality 

tutor teaching 
abili ty 



3 
2 

12(10) 
11(9) 

1 
5 



8 

13(11) 
6 



9 

10 



1 

10 



2 
6 



8 

11 

4 



3' 
1 

12(10) 



2 
4 



13(1.1) 

: 8- 



10 

t 

11 



Notes: items Jn parenthesis above are the adjusted ranks of .tho^^e item$ that 
is, in the TVI and 10:152 lists, if the two items about tutors- .are re- , 
maved then other item ranks increase as shown 




GRADE DISTRIBUTIONS IN CALCULUS 
)0:150 - 10:152 FROH WINTER 1976 
TO SPRING 1979 



calculus 10:150-151-152 
* % grades " 



QUARTER . 


COURSE 


n 


A 


8 


C 


• 0/ 


F 


1/M 


W 


76 


FBI 51 


34 


18 


29 


24 


6 


15 


9 


SP 


'7'7 
11 


151 


180 


13 


18 


27 ' 


14 


14^- 

J* 


y 13 


Cl IM 




1 oU 


Jo 


1 ft 


1 O 


^1 

CI 






lU 


F 


11 


t DU 


OoO 


LI 






1 L 


Q 
O 


; JU . 


F 


11 . 

f 


151 


70 


.14 . 


24 ^ 


21 


20 




13 


W 


78 


150 


144 


27 ^ 


11 


16 


13 


23 


11 


W 


78 


151 


527 


24 


25 


• 24 


13 


6 


9 " 












r 






SP 


78. V 


151 


154 


13 


22' 


25 


i 9 


7 * 


23 






















SUM 


78 


' F150 


- 35 


26 


37 


"14 


3 


• 3 


17 


1^ 


78 


150 


781 


22 


23 


25 


10 


10 


10 

« 


F " 


78 


F150 


24 • 


30 


26 


17 


9 


4 


13 


F • 


78 


151 


ev 


36 


34 


21 


2 


2 


- 5 


F 


78 


F151 


28 


18^ 


36 


29 


11 


0^ 


7 


SP 


79 


150 


19 


5 


32 


26 


. 16 


5 


6 


SP 




151 


157 


13 


17 


28 ' 


23 


6 


14 


SP 


J9 ^ 


F152 


31 


19 


42 


26 


0 


0 


12 


SP 


79 


1.52 


480 


19 


21 • 


20 


12 


^ 6 


14 



j 



'NOTE: Underlined items indicate Prof. Filgo's classes 

The item listed first Is a class co-tauqht by Prof- Filgo and 
Prof, Bridger in th*e winter 1976 quarter 

The items which are not designated as Prof. Filgo's classes are the 
combined figures for all other classes/sections 
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